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SUMMARY 


The advent and widespread use of the computer-generated image (CGI) 
device to simulate visual cues has had a mixed impact on the realism and 
fidelity of flight simulators. On the plus side, CGIs can provide greater 
flexibility in scene content than terrain boards and closed-circuit tele- 
vision-based visual systems can, and they have the potential for a greater 
field of view. However, on the minus side, CGIs introduce into the visual 
simulation relatively long time delays. In many state-of-the-art CGIs, 
this delay is as much as 200 ms, which is comparable to the inherent delay 
time of the pilot. Because most GCIs use multiloop processing and smooth- 
ing algorithms and are linked to a multiloop host computer, it is seldom 
possible to identify a unique throughput time delay, and it is therefore 
difficult to quantify the performance of the closed-loop pilot-simulator 
system relative to the "real world" task. This paper describes a method 
to address these issues using the STI-developed Critical Task Tester 
(CTT). Some empirical results from applying the method are presented, and 
a novel technique for improving the performance of CGIs is discussed. 


BACKGROUND AND INTRODUCTION 


Modern flight simulators usually employ a "host" digital computer in 
order to represent the mathematical model of the aircraft dynamics, the 
flight control system, the equations of motion, and the environmental 
disturbances. A "satellite" digital computer generates the dynamic exter- 
nal visual field which is output to one or more cathode-ray tube (CRT) 
displays. The combined process of generating and displaying the external 
visual field is usually referred to as a computer-generated image (CGI). 
The pilot "flies" the aircraft by monitoring the CGI, and his control 
outputs, <j>, are inputs to the host computer. This closed-loop process is 
depicted in the block diagram shown in Fig. 1. 

In order to conserve computer resources and minimize digital delays, 
both the host and the CGI computers usually employ multiloop architec- 
tures. In addition, the CGI computer uses smoothing algorithms in order 
to prevent the visual scene from "jumping" on the display. The data 
transfer between the host and CGI computers is almost always asynchronous. 
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Figure 1. Functional Block Diagram of Architecture for Host and 
CGI Computers Used in Modern Flight Simulators 


Because of the complex architecture used in the computers of modern 
flight simulators, it is very difficult to identify the effective time 
delay of the overall system, or, more importantly, to identify how the 
performance of the simulator compares to that of the real world. In many 
state-of-the-art CGIs, this delay is as much as 200 ms (Ref. 1), which is 
comparable to the inherent delay time of the pilot. For some flight tasks 
(e.g., up-and-away flight), this much delay is tolerable. For others 
(e.g., precision hover or landing), it is intolerable and completely un- 
realistic. When a pilot is unable to perform a task in a simulator, he 

often does not know exactly what is wrong; he knows only that he can per- 
form the same task in the real world (Ref. 2). On the other hand, if the 
pilot can perform the task, he often complains that the workload is much 
higher than that in the real world. One explanation for both of these 

problems is that the pilot must generate lead in order to compensate for 

the lag in the CGI. 

The primary purpose of this paper is to describe a method which can 
both measure the effective time delay of a modem flight simulator and 
quantify the performance of the closed-loop pilot -Simula tor system rela- 
tive to the "real world." Since this method is independent of the 
hardware and software of the computers used in the simulator, it offers a 
rational means for evaluating hardware and/or software changes to any part 
of the flight simulator. 

The remainder of this paper describes the proposed method and presents 
some empirical results of applying the method. A novel technique for 

improving the performance of visual simulators is also presented and 
discussed . 


174 





DESCRIPTION OF THE METHOD 


The proposed method is based on human operator (HO) performance degra- 
dation in performing a manual control task. The particular manual control 
task is to stabilize an unstable controlled element using the critical 
tracking task (CTT, Refs. 3 and 4), as depicted in Fig. 2. The HO uses a 
manipulator, 6, to null the error, e, which is displayed on a CRT. The 
task is automatically paced in the sense that the unstable pole, X, in- 
creases slowly with time, thus making the task progressively more 
difficult. At some point, the HO can no longer control the error, e, and 
the value of e exceeds a preset value. At this point, the task ends, and 
the corresponding final value of X is defined to be the critical task 
score, X c » 

The CTT has been used in numerous experiments involving the human 
operator. Most of these experiments have examined the performance degra- 
dation of the HO due to exogenous effects such as alcohol, drugs, and 
prolonged bed rest (Refs. 5 through 8). It is also possible, however, to 
use the CTT in order to examine the performance degradation of the HO due 
to divided attention (Refs. 9 and 10) and other causes within the display 
(Refs. 11 and 12), the manipulator (Ref. 13), or the order of the unstable 
controlled element itself (Refs. 13 and 14). It is the causes of HO per- 
formance degradation between the operator's manipulator and a CGI display 
that forms the basis for the proposed method. 

Consider now the modified CTT block diagram shown in Fig. 3. A CGI 
with sample update period, T g , is now used to display the error signal, 
e. The control output of the HO, 6, is sampled at period Tg. (T g and Tg 
were equal but not synchronized for the results described herein.) 
Figure 3 represents the essential features of a modern flight simulator 
that uses one or more digital computers to sample and process the pilot's 
output and a CGI to display the state of the vehicle to the pilot in terms 
of a simulated appearance of the external field of view. Figure 2 can be 
thought of as the "real-world" counterpart of Fig. 3, where the display is 
continuous, and there is no delay due to sampled data effects. 

Because the variability in X c for a well-trained subject is suffi- 
ciently low (Refs. 3 and 15), the continuous (i.e., Fig. 2) and discrete 
(i.e.. Fig. 3) versions of the CTT offer a unique means for comparing the 
effects of sampled data systems and CGI displays on the performance of the 
human operator. 


SOME EMPIRICAL RESULTS 


The results of an initial investigation of the effects of T g and Tg 
from the sampled, first-order CTT described in Fig. 3 are shown in 
Fig. 4. Note that the mean score, X c , is a linear function of the sample 
periods, T g and T§. Also note that there is low variability in the data, 
as evidenced by the low values of the standard deviations. Using the zero 
time delay score as a reference point (i.e., X c ± 6.5 rad/ sec), the 
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Figure 2. Functional Block Diagram of Critical Task Tester (CTT) 
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Note: The process of updating and holding a sample for one frame time, T, 

is modeled with a zero-order hold (ZOH): 

M = (1 - e“ Ts )/s 

o ' ' 

where T is the time delay associated with either T g or Tg 


Figure 3. CTT with Computer-Generated Display and Sampled Data System 
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performance at 100 ms throughput delay Is degraded by about 26 percent 
and, at 200 ms, by 49 percent! If we can extrapolate these results to 
other flight tasks , it is no wonder that pilots complain that they cannot 
perform real-world tasks in a flight simulator. 

The discrete version of the first-order CTT in Fig. 3 thus offers a 
simple, convenient, and portable means for comparing the degradation in HO 
performance which accompanies throughput time delay and update rate be- 
tween the pilot's manipulator and the CGI. It also meets the objectives 
stated at the beginning of this paper, i.e., to measure the effective time 
delay of a modern flight simulator and to quantify the performance of the 
closed-loop pilot -Simula tor system relative to the real world. The proce- 
dure for doing this in any given flight simulator is as follows: 

1. Program the CTT algorithm in the host computer. Options for 
driving any one of the six axes of the CGI should be 
provided . 

2. Establish a reference curve for A c versus the cycle time of 
the host computer. A separate curve must be established for 
each controller-display-operator combination. 

3. Since the host computer will not be able to run at zero cycle 
time, each controller-display-operator combination must be 
extrapolated to the zero cycle time point. This point, A co , 
will be used as the "real world" reference point. 

4. The effective throughput time delay of the total simulator, 
i.e., host computer and CGI, is calculated as follows: 


T 


eff 



where A ct is the value of A c at the normal operating point of 
the host computer. The above equation is based on the total 
throughput delay of the HO and digital computers being 
proportional to the inverse CTT score (Ref. 4). In general, 

the value of T e f£ will not be the same as the "exact" 
throughput time delay. Hence the name "effective throughput 
time delay" is given. 


Note that the procedure outlined above offers a rational means of 
evaluating the performance of a flight simulator. It also provides a 

method for evaluating changes to any component of the simulator. For 
example, the technique for improving the performance of a CGI that is 
discussed in the next section could be evaluated by this procedure. 
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A NOVEL TECHNIQUE FOR IMPROVING THE PERFORMANCE OF 
COMPUTER-GENERATED IMAGES 


One way to compensate for the lag due to time delay in the combined 
host computer and CGI is to use lead in the signals being sent to the 
CGI. There are limitations in doing this, because the host computer can- 
not generate lead beyond the Nyquist frequency, and linear lead filters 
distort the amplitude response at the expense of obtaining the correct 
phase response. To overcome the first of these restrictions, the hybrid 
approach shown in Fig. 5 -could be used. 
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Figure 5. Functional Block Diagram of Advanced Hybrid Architecture 
Proposed for Host and CGI Computers 


Note that there are two "host" computers, one digital and one analog 
(hence the name "hybrid"). The host digital computer simulates the low- 
frequency vehicle dynamics (xjj?) > where "low frequency" means up to the 
Nyquist frequency, it/ T^; the host analog computer simulates the high- 
frequency vehicle dynamics (xjjp) , where "high frequency" means above tt/ T ^ ; 
and it compensates x^p to account for lags in the CGI digital computer. 
The CGI digital computer then combines Xq,p and ^HF via "complimentary 
filtering" in order to form the final vehicle states, x_> which are dis- 
played to the HO. A simple first-order complimentary filter is shown 
below , 
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where the break frequency, a, is chosen to be just below the Nyquist fre- 
quency , ir /T i . 

The compensation technique we propose to implement in the host analog 
computer was first reported in Ref. 16 and then later in Ref. 17. The 
technique, called the Split Path Nonlinear Filter or SPAN is shown in 
Fig. 6. The advantages of SPAN are that (1) it provides conditionally 
independent magnitude and phase angle specification (e.g., it can generate 
phase lead without amplitude distortion!) and (2) it is not dependent on 
input signal amplitude. On the other hand, the possible disadvantages of 
SPAN are that (1) the output will contain harmonic distortion which may 
need to be attenuated and (2) if the linear filter in the magnitude con- 
trol path (F m ) contributes phase shift, it will be reflected in the 
output, hence the magnitude control path is conditionally independent. 


Magnitude Control Path 



Phase Control Path 


Figure 6. Flight Simulator Delay Compensation by Means of 
Split-Path Nonlinear Independent Magnitude and Phase Filters 
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The procedure outlined above needs to be tested under carefully con- 
trolled conditions. The CTT method described in this paper offers a 
unique way of quantitatively evaluating this novel technique for improving 
the performance of visual simulators. 
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